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TRANSMI SSION OF MMS MESSAGES WITH THE CQ WVFRSTON OF DATA 
^TYPES ANT? ^Q P PflTfr F^RNATfi , 

The present invention relates to a method for transmitting data 
according to the preamble of Claim 1, a sender and/or receiver 
terminal, a computer program product and a communications 
system. The use of the term data in the present invention 
includes all types of information that can be compiled from the 
individual components. The individual components or elements 
can be structured, organized and/or coded according to 
different standards. Accordingly, data can represent multimedia 
messages that comprise diverse elements with different 
standards . 

Methods and apparatus for transferring various data types or 
formats are known. For example, in addition to voice telephony, 
a mobile radio system as per the Global System for Mobile 
Communications Standard GSM already offers the option of 
sending or receiving information in the form of text messages 
up to 160 characters long. This service is known as the Short 
Message Service SMS. 

For next -generation mobile radio systems, such as the Universal 
Mobile Telecommunication System UMTS, a multimedia-capable 
version of the mobile messaging service is currently being 
standardized. This service is known as the Multimedia Messaging 
Service MMS. The Multimedia Messaging Service MMS specifies 
mechanisms to transport various content from one subscriber of 
the service via a network to another subscriber. In this 
document, messages with multimedia content will be known simply 
as multimedia messages MM to better differentiate them from SMS 
text messages. By contrast with the SMS, there is no 
restriction to pure text content with the Multimedia Messaging 
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Service MMS . In the MMS, it is also be possible to format texts 
however you like and embed any content in a message. This 
includes audio and video content, graphics and text. The 
individual multimedia components of a multimedia message, also 
known as MM elements, can also contain references to other data 
known as links. Data referenced in this way can either be 
integrated into the multimedia message MM as an additional MM 
element or stored in external memory space for downloading 
later, for example on a server in a network. 

The disclosure below refers in general to data quantities 
comprising individual elements of text and/or image data with 
or without sound that are coded to the same or different 
standards even though the application of the aforementioned 
standard is a key area of application for the present 
invention . 

A communication system for transmitting this type of data 
essentially comprises three layers: a layer of a data sender 
with an MMS user application or an MMS user agent, a layer of 
at least one service provider whose network element triggers 
the service and is hereinafter referred to as an MMS connection 
unit or MMS relay/server, and lastly a layer of a receiver with 
an appropriate MMS user application. The term MMS user 
application covers an application on both the sender and 
receiver side, for example on a mobile phone that implements 
MMS functionality. 

Usually, a mobile phone equipped with an MMS user application 
does not support all the existing data types or data formats. 
Current developments indicate a greater number of different 
data formats for various special applications that in future 
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may be of interest as elements of a multimedia message. 
Upgrading all subscriber terminals can practically be excluded 
due to the high numbers involved and the high software 
maintenance intervals dictated by development. It can be 
assumed that an MMS user application in a subscriber terminal 
can therefore only ever process a selection of the growing 
number of different data formats. The information as to which 
data types and data formats are supported by a particular MMS 
user application (in addition to other individual features of 
the MMS user application) is part of the MMS user application 
profile or MMS user agent profile that has to be known to the 
MMS service provider before multimedia messages can be 
exchanged. For this purpose, the information is transferred at 
the beginning of every MMS session from the appropriate 
terminal to the network and stored there. Given that the 
information from the MMS user application profile is known to 
the MMS relay/server of the MMS service provider, this enables 
it to undertake data type conversions/code conversions and file 
format conversions. Only those data types and data formats are 
then forwarded to a MMS user application that it can process. 
If a MMS relay/server receives a multimedia message that 
comprises two MM elements, where the first MM element contains 
a link to the second MM element and the data type or data 
format of the second MM element has to be converted before the 
multimedia message is forwarded to the recipient in accordance 
with the information from the MMS user agent profile, then the 
link in the first MM element is errored after the conversion 
and can no longer be resolved. 

The object of the present invention is to propose a method, a 
sender and/or receiver terminal, a computer program product and 
a communications system that provides a data or message sender 
additional options for sending data with a higher degree of 
flexibility with error- free adaptation for every combination of 
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data and data formats to a given communication system and/or 
MMS user application. 

According to the present invention, this object is achieved by 
a method in accordance with the features of Claim 1 and a 
subscriber/receiver terminal with the features of Claim 7. A 
communication system with the features of Claim 10 provides a 
possible solution. The subclaims define the preferred and 
beneficial embodiments of the present invention. 

A method according to the present invention for transmitting 
data in a communication system, in particular transmitting text 
and/or image data with or without sound that is coded to the 
same or different standards, is characterized in the present 
invention in that data type and/or data format conversion is 
undertaken in accordance with a profile of a receiver in which 
a link is changed appropriately to preserve the validity of 
this link in the data and/or between different data elements of 
the data type and/or data format conversion. In other words, 
when converting a data type and/or data format in accordance ; 
with a profile of a receiver to preserve the validity of one or 
more references in the data between different data elements, at 
least one link is updated. According to the present invention 
it is therefore possible as a result of an automatic link 
update after a data type and/or data format conversion that 
internal references remain valid even after conversion of data 
types and/or data formats and that a multimedia message can 
always be completely displayed to the receiver in adapted form 
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as per the sender's requirements. According to the present 
invention, both internal and external references are 
considered, as is described in an embodiment with reference to 
the accompanying drawings . 

In a further development of the invention, the conversion is 
undertaken at the provider of the receiver. The resources 
required for such processing are envisaged in a message 
transmission network and would relieve in particular the load 
on the subscriber terminal in terms of required processing 
power and contribute to a reduction in energy consumption. 

In a preferred embodiment of the invention, a link in the data 
between the different elements is verified. This would mean 
that any errors in the data structure could be detected and 
possibly cleared but in any case notified to the sender. In one 
embodiment a decision can then be made as to whether the 
damaged or errored data record should be transmitted or deleted 
and resent by the sender. 

The data for transmission would preferably be prepared such 
that it contains a header to transport organization information 
and a body to transmit the appropriate useful information. The 
useful information preferably comprises elements in the form of 
a plurality of data packets. In a preferred embodiment, the 
data is transmitted from a user application of a subscriber via 
a network to a user application of another subscriber in which 
the transmission is controlled by transactions and/or 
information elements of a transport protocol added to the data, 
whereby the information elements comprise a field name and an 
appropriate field value. A method according to the present 
invention is preferably used for data which is transmitted as a 
multimedia message MM in a Multimedia Messaging Service MMS in 
particular on a mobile subscriber terminal or specifically on a 
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WAP-capable mobile phone as per the GSM, GPRS, EDGE or UMTS 
standard or combinations thereof. 

The Multimedia Messaging Service MMS, the preferred area of 
application of the present invention, does not currently offer 
any measures for intercepting, verifying or securely converting 
external references for easier integration of applications. 
With the embodiments of the present invention, it will be 
possible to adapt internal and external references by means of 
a sending application with such a high level of reliability 
that it can be assumed that complete and secure forwarding is 
guaranteed. 

The present invention will now be described in more detail with 
reference to the accompanying drawings on the basis of 
preferred embodiments. The drawings show: 

Figure 1 a schematic diagram of an MMS network architecture as 
per 3GPP; 

Figure 2 a flow diagram in which the link in the first MM 
element has to be reconciled after the data format conversion 
of the second MM element; 

Figure 3 a diagram of an incoming MM in the MMSE that contains 
a link to a file that is situated on an external server and 

Figure 4 a diagram in which a link points to a memory location 
in the MMSE of the MMS service provider after data type 
conversion and/or data format conversion. 
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Elements with the same function and mode of operation are 
labeled with the same references or abbreviations in Figures 1 
to 4. 

As already described at the start of this document, the 
Multimedia Messaging Service MMS enables the transmission of 
multimedia messages in which formatted text and images with or 
without sound can be received. The existing restriction in the 
SMS to a text message length of 160 characters is no longer 
applicable. Transmission of among other things audio and video 
messages is possible, but the very frequently used SMS messages 
will continue to be processed within the system in the present 
invention with resources to match, as is described in the 
summary of the prior art . 

MMS can be implemented using WAP . For radio transmission of 
data, such as multimedia messages MM the communication system 
as shown in Figure 1 should be used. The diagram in Figure 1 
shows a diagram with the prior art from the point of view of 
3GPP depicting the exchange of a multimedia message MM between 
three participating instances in sending and receiving an MM. 
This communication system 1 comprises a layer 2 of a data 
sender, also labeled as an MMS user application A or MMS user 
agent A M-UA_A. The term MMS user application covers an 
application for example on a mobile phone that implements MMS 
functionality. Furthermore, a layer 3 of a service provider 
SPro is envisaged whose network element triggers the services 
and is hereinafter referred to as an MMS connection unit or MMS 
relay/server MMS-RS. An MMS relay/server MMS-RS is a network 
element that enables the MMS user application MMS-UA to 
communicate via the network in an area of responsibility or in 
the Multimedia Messaging Service Environment MMSE of the MMS 
service provider SPro and provides the MMS functionality. In 
this example, the interface between layers 2 and 3 is shown as 
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a radio network RN A instead of a dedicated network connection 
for transmitting a multimedia message MM1 . Finally, a layer 4 
is envisaged as a layer of a receiver that is also designated 
as an MMS user application B M-UA B. A radio network RN B is 
5 also envisaged here for transmitting the multimedia message 
MM1. 

More than just one provider SPro can of course appear in layer 
3 . This is possible because the data sender M-UA_A and the 

10 selected receiver M-UA B can be contracted to different 

providers SPro A, SPro B as shown in Figure 1. Furthermore, 
these different providers can be associated with one another 
through a third provider as a network operator. Here however, 
the simpler representation is shown since the precise structure 

15 of layer 3 and the type of transport adaptation of a message 
e.g. from MM1 to MM 4 etc., is of no interest for the 
representation of the present invention. 

Generally, a mobile phone equipped with an MMS user agent MMS- 
20 UA does not support all the existing data types or data 
formats. The information as to which data types and data 
formats are supported by a particular MMS user agent MMS-UA (in 
addition to other individual features of the MMS user agent) is 
part of the MMS user agent profile that has to be known to the 

2 5 MMS service provider SPro before multimedia messages MM can be 

exchanged. This information is therefore transferred at the 
beginning of every MMS session from the terminal to the network 
and stored there. Given that the information from the MMS user 
agent profile is known to the MMS relay/server MMS-RS of the 

3 0 MMS Service Provider SPro, this enables it to undertake data 

type conversions /code conversions and file format conversions. 
Only those data types and data formats are then forwarded to a 
MMS user agent MMS-UA that it can process. The size of a file 
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may change considerably through conversion. The sub-division of 
data into data types represents a broad classification of data 
that belong to different media types such as audio, text or 
static images. The data format however provides actual 
5 information about the coding of a certain data type such as MP3 
coded audio file or a JPEG coded static image. The data format 
of a file is uniquely identifiable by the extension appended to 
the filename. For example, a static image coded to the JPEG 
standard has the extension "jpg" after the filename. The file 
10 name and the extension are generally separated by a full stop 
for example: "holiday . jpg" . 

If an MMS relay/server MMS-RS receives a multimedia message MM 
that comprises two MM elements MM-E1 , MM-E2, where the first MM 

15 element MM-E1 contains a link to the second MM element MM-E2 

and the data type or data format of the second MM element MM-E2 
has to be converted before the multimedia message MM is 
forwarded to the recipient in accordance with the- information 
from the MMS user agent profile, the link in the first MM 

20 element MM -El is errored after the conversion and can no longer 
be resolved. 

Until now there has been no provision for converting externally 
stored files that are linked from an MM element MM-E in 
25 accordance with the information in a MMS user agent profile of 
the receiver B and for adapting the link in the multimedia 
message MM after the conversion. 

A multimedia message MM essentially comprises a header and 
30 optionally a body that contains the multimedia elements MM-E. 
Since not only each multimedia message MM itself but also each 
individual element MM-E of the multimedia message MM 
essentially comprises a header and a body, it is also possible 
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that a link LK for referencing a file can be contained either 
in the header of the multimedia message MM and/or in the header 
of the relevant MM element and/or in the body. A method 
according to the present invention is used in which for links 
5 within a multimedia message MM, i.e. between different MM 

elements MM-E, not only the data types and/or data formats of 
the MM elements are converted in accordance with the current 
MMS user agent profile of the receiver, but also the associated 
link within the MM. In a further development of this method, 
10 the aforementioned principle can be applied to externally 
stored files and their links, i.e. to files that are for 
example stored on a server EXT and are not part of the MM. 

Two examples for the aforementioned mechanisms for coordinating 
15 links after conversion of data types and/or data formats are 
described below with reference to diagrams. Firstly, a case 
will be considered in which a link within a multimedia message 
MM between different MM elements remains valid after 
conversion. The second case concerns a link to a file stored on 
20 a server that is referenced from the multimedia message MM. 

Here a link to incorporate multimedia objects is represented by 
way of example as a Uniform Resource Location or URL link. In 
theory, other types are of link are possible but because of 
their comparatively greater load during implementation, they 
2 5 are not considered further here. 

1. Link within a multimedia message MM: 

A multimedia message MM that contains two MM elements MM-E1, 
MM-E2 arrives at the MMS relay/server MMS-RS of the receiver. 
30 The first MM element MM-E1 is an SMIL presentation, i.e. a 

presentation that is described in a language standardized by 
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the World Wide Web consortium W3C for synchronizing multimedia 
contents as per [4] . The first MM element MM- El contains a link 
to a second MM element MM-E2, in this example a file of the 
data type DT 'static image' of the data format DF "GIF" that is 
characterized with the characteristic file identifier or 
extension "gif". The MMS user agent of the receiver is however 
not able to display this data format. Consequently, the MMS 
relay/server converts the data format DF of the linked file in 
accordance with the MMS user agent profile into another data 
format DF, here for example JPEG, characterized by the 
extension "jpg" appended to the filename before the 
presentation of the entire multimedia message MM to the MMS 
user agent. This summary is shown in the diagram in Figure 2. 

In accordance with the present invention, the link LK 1 to the 
second MM element MM-E2 is now also reconciled after the 
conversion KONV. In this case, the extension in the link simply 
has to be adapted so that the new link LK 2 to the now 
converted element MM-E2 only differs from the old link LK 1 by 
the extension: Before conversion: LK 1 = "/privat/holiday .gif " 
After conversion: LK 2 = " /privat/holiday . jpg" . 

2. External link: 

A multimedia message MM that arrives at the MMS relay/server 
MMS-RS of the receiver as per reference point 1 in the diagram 
of Figure 3 contains as reference point 2 a link LK 2 to an 
external memory location. In accordance with the present 
invention, before the multimedia message MM is forwarded to the 
MMS user agent of the receiver a verification is carried out as 
to whether the data type and/or the data format of the file 
referenced by the link has to be converted in accordance with 
the requirements of the MMS user agent profile. If the MMS 
relay/server MMS-RS detects the need for a conversion, it has 
to first read the file from the given memory location and 
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buffer it in the MMSE of the MMS service provider SPro for the 
purposes of conversion as per reference point 3 . 

The file converted in accordance with the MMS user agent 
5 profile can then not be re-saved in the external server EXT 
since it must generally be assumed that the MMS service 
provider SPro does not have any write rights to the external 
server EXT. Instead, the converted file must be stored in the 
MMSE of the MMS service provider SPro in the MMS relay/server 
10 or on another server that is connected to the MMS relay/server 
but not shown in this diagram. 

By contrast with case 1 described above, an adaptation of the 
extension in the link is now no longer sufficient since, as a 

15 result of the new memory location of the converted file, the 
entire path has changed. Instead, the old link LK 1 must be 
completely replaced by a new link to the memory location within 
the MMSE of the MMS service provider SPro. This reconciliation 
of the link must occur before the multimedia message MM is 

2 0 forwarded to the MMS user agent of the receiver, see reference 
point 4 in the diagram in Figure 4 . 

If the MMS user agent of the receiver wants to trigger the new 
link 2 in the multimedia message MM, it finds at the referenced 
25 memory location a file converted in accordance with the 

requirements from the MMS user agent profile; see reference 
point 5 in the diagram in Figure 4 . 

Link LK 1 - before conversion: 
30 http://www.external_server.de/public/pictures/holiday.gif Link 

LK 2 - after conversion: 

http://www.MMS service provider/pics/holiday . jpg 
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In an alternative embodiment, a method is executed in which 
each external link within a multimedia message MM is 
automatically replaced on arrival in the MMSE of a MMS service 
provider SPro by a new link LK which links to a placeholder for 
a possible storage space in the MMSE of the MMS service 
provider SPro. Converted files can be saved to these memory 
locations in the MMSE at a later stage, i.e. on request. The 
conversion itself in this embodiment can optionally be first 
carried out when file download is executed with the help of the 
link LK from the terminal or the MMS user application MMS-UA. 

To summarize, a method is proposed in which every MM that 
arrives at the MMS relay/server of the receiver is verified to 
see whether it contains a link to another file. This means 
that, where appropriate, all header fields in the header of the 
MM and in the headers of the individual MM elements must be 
verified. Furthermore, the method described usually requires 
that MM element MM-E that may contain a link, for example SMIL, 
html or txt, to be opened. Other MM elements MM-E that cannot 
contain references do not need to be opened. This affects audio 
files or static images for example. Since the MM elements MM-E 
that have to be opened are as a rule much smaller than MM 
elements MM-E that do not have to be opened, the additional 
processing load in the MMS relay/server MMS-RS of the MMS 
service provider SPro is very low. With the described method, 
the MMS service provider SPro can guarantee to his customers 
that all links, both internal links and external links, 
contained in a multimedia message MM can be triggered in 
accordance with the information from the MMS user agent profile 
of the receiver B. 
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There are many benefits of a method in accordance with the 
present invention : 

• Firstly, references within an MM and between different MM 
elements remain valid after any data type and/or data 

5 format conversion in accordance with the MMS user agent 

profile of the receiver in the MMS relay/server of the 
receiver . 

• Secondly, it is proposed, for references from an MM to 
externally stored files, to check whether the data type 

10 and/or data format has to be converted in accordance with 

the information of the MMS user agent profile of a 
receiver by the MMS relay/server of the receiver and 
whether this link has to be adapted accordingly after 
successful conversion. 

15 

With a method of the type described above, it is therefore 
guaranteed that in a multimedia message MM with internal links 
LK that even after conversion of the data type and/or data 
format that this link LK remains valid. Furthermore it is 
2 0 guaranteed that an MMS user agent receives files available for 
download with data types or data formats that he is in a 
position to process as a receiver application even for an MM 
with external references to files that are stored on an 
external server EXT and are not part of the MM. This is the 

2 5 only way to ensure that the MM can always be completely 

presented in a terminal and in the way in which the sender 
intended. 

The Multimedia Messaging Service MMS specifies mechanisms for 

3 0 transporting any content from a subscriber of the service via a 

network to another subscriber, with the information elements of 
the message that can be used for the message transport, the 
header fields, being able to be employed very flexibly. In 
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summary, several options are proposed for supporting attractive 
applications for diverse known message types, including those 
in MMS, whereby the efficiency of the message flow is 
beneficially improved in that according to the present 
5 invention any multimedia message MM can be adapted to the 

facilities of the receiver and/or set up and displayed as per 
the provisions of the sender. Transmitting short text messages 
such as messages from the Short Message Service SMS with a link 
to other sources i.e. for example references to external 
10 internet sites that can be called up with an external 

application such as an internet browser, poses no problem. The 
present invention also enables structure -conformant integration 
of known message flows for all known and future data formats in 
adapted form together with the appropriate benefits. 

15 

Background details on WAP, MMS and cited new code languages are 
summarized in the following documents: 

[1] 3GPP TS 23.040 version 5.3.0, Release 5; Third Generation 
Partnership Project; Technical Specification Group Terminals; 
20 Technical realization of the Short Message Service (SMS) . 

[2] 3GPP TS 22.140 version 5.1.0, Release 5; Third Generation 
Partnership Project; Technical Specification Group Services and 
System Aspects; Multimedia Messaging Service (MMS) ; Service 
Aspects; Stage 1. 

25 [3] 3GPP TS 23.140 version 5.2.0, Release 5; Third Generation 
Partnership Project; Technical Specification Group Terminals; 
Multimedia Messaging Service (MMS) ; Functional Description; 
Stage 2 . 
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[4] Synchronized Multimedia Integration Language, SMIL version 
2.0; World Wide Web Consortium; W3C Recommendation; 07 August 
2001. 

Furthermore, as part of the present representation of an 
embodiment of the invention, the following labels and 
abbreviations are used in particular: 

1 Communication system 

2 Layer of a data sender 

3 Layer of a provider/ s 

4 Layer of a receiver 

GSM Global System for Mobile Communication 
SMS Short Message Service 

UMTS Universal Mobile Telecommunication System 
WAP Wireless Application Protocol 
WSP Wireless Session Protocol 
MM Multimedia message 

MM1-4 Multimedia message with transport adaptation 

MMS Multimedia Messaging Service 

MM-E Element of a multimedia message 

MMSE Multimedia Messaging Service Environment 

SMIL Presentation in SMIL /Synchronized Multimedia Integration 
Language 

SMTP Simple Mail Transfer Protocol 

LK Link 

F External file 

DT Data type 

DF Data format 

EXT External server 

MMS-UA MMS user application 

MMS-UA A MMS User Agent A, Sender of an MM, Figure 1 
MMS-UA B MMS User Agent B, Receiver of an MM, Figure 1 
MMS-RS MMS connection unit / MMS relay/server 

KONV Conversion 
RN Radio Network 
SPro Service Provider 



